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Abstract 

In this paper, new techniques are presented to either simplify or improve most existing upper 
bounds on the maximum-likelihood (ML) decoding performance of the binary linear codes over additive 
white Gaussian noise (AWGN) channels. Firstly, the recently proposed union bound using truncated 
weight spectrum by Ma et al is re-derived in a detailed way based on Gallager's first bounding 
technique (GFBT), where the "good region" is specified by a sub-optimal list decoding algorithm. The 
error probability caused by the bad region can be upper-bounded by the tail-probability of a binomial 
distribution, while the error probability caused by the good region can be upper-bounded by most existing 
techniques. Secondly, we propose two techniques to tighten the union bound on the error probability 
caused by the good region. The first technique is based on pair-wise error probabilities. The second 
technique is based on triplet-wise error probabilities, which can be upper-bounded by the fact that any 
three bipolar vectors form a non-obtuse triangle. The proposed bounds improve the conventional union 
bounds but have a similar complexity since they involve only the Q-function. The proposed bounds can 
also be adapted to bit-error probabilities. 
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I. Introduction 

In most scenarios, there do not exist easy ways to compute the exact decoding error probabili- 
ties for specific codes and ensembles. Therefore, deriving tight analytical bounds is an important 
research subject in the field of coding theory and practice. Since the early 1990s, spurred by 
the successes of the near-capacity-achieving codes, renewed attentions have been paid to the 
performance analysis of the maximum-likelihood (ML) decoding algorithm. Though the ML 
decoding algorithm is prohibitively complex for most practical codes, tight bounds can be used 
to predict their performance without resorting to computer simulations. As shown in [IJLtl 020 , 



most bounding technic 



Gallager-Fano bound [|7 



ues have connections to either the 1965 Gallager bound O-ly] or the 1961 



1811 . This paper is relevant to the 1961 Gallager-Fano bound, which is 



also called Gallager's first bounding technique (GFBT) in the literature. Our efforts focus on 
tightening the simplest conventional union bound, which is simple but loose and even diverges 
in the low-SNR region. Similar to many previously reported upper bounds surveyed in [2], our 
basic approach is based on GFBT 

Pi{E} = Pr{E,yen} + Pi{E,y£n} (1) 
< Pr{E,yen} + Pi{y^n}, (2) 

where E denotes the error event, y denotes the received signal vector, and 1Z denotes an arbitrary 
region around the transmitted signal vector which is usually interpreted as the "good region". 
As pointed out in [2], the choice of the region TZ is very significant, and different choices of this 
region have resulted in various different improved upper bounds. Intuitively, the more similar 
the region 1Z is to the Voronoi region of the transmitted codeword, the tighter the upper bound 
is. However, most existing improved upper bounds have higher computational complexity than 
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the conventional union bound. 

Different from most of the existing works, we define the good region using a list decoding 
algorithm. The basic idea is as follows. Upper bounds on the word-error probability for the list 
decoding algorithm (which is suboptimal) can also be applied to an ML decoding algorithm, 
while the list decoding algorithm can limit competitive candidate codewords. 

Structure: The rest of this paper is organized as follows. In Sec. HO we present an upper bound 
of the angle formed by any three bipolar vectors, which will be used to upper-bound the triplet- 
wise error probabilities. In Sec. [nil we re-derive, in a detailed way within the framework of the 
GFBT, the recently proposed union bound using truncated weight spectrum by Ma et al [19]. 
On one hand, the truncation technique is helpful when the whole weight spectrum is unknown 
or not computable. On the other hand, the truncation technique can be combined with any 
other upper-bounding techniques, potentially resulting in tighter upper bounds. In Sec. |IVj we 
propose two techniques to improve the union bound. The first technique is based on the pair- 
wise error probabilities, which can be tightened by employing the independence of the error 
event and certain components of the received random vectors. The second technique is based 
on the triplet- wise error probabilities, which is shown to be a non-decreasing function of the 
angle formed by the transmitted codeword and the other two codewords. In Sec. |Vj the proposed 
bounds are adapted to ensembles of codes and bit-error probabilities. Numerical examples are 
provided in Sec. |VI] and we conclude this paper in Sec. IVII1 



A. Geometrical Properties of Binary Codes 

Let F 2 = {0, 1} and A 2 = { — 1, +1} be the binary field and the bipolar signal set, respectively. 
We use Wh{v) to denote the Hamming weight of a binary vector v — (vq, i>i, • • • , f n -i) £ Fj. 
We use \\y\\ to denote the magnitude of a real vector y = (yo,yi,- 44 iVn-i) £ that is, 



II. Preliminaries 



y\\ = 




f. Let C[n, k] be a binary linear block code of dimension k and length n with 



January 19, 2013 



DRAFT 



4 



IEEE TRANSACTIONS ON COMMUNICATIONS 



O 




(b) 



Fig. 1. Geometrical representation of three bipolar vectors. 



a generator matrix G of size k x n, that is, 



C = {ceF™ | c = uG,ue¥ k 2 ) . 



(3) 



Let Aij denote the number of codewords c = uG with W H (u) = % and W H (c) = j. Then 
{Aj = < j <n} is referred to as the weight spectrum of the given code C. 

Consider the binary phase shift keying (BPSK) mapping <f> : F$ t-> A% taking s = <fi(v) by 
s t — 1 — 2v t for < t < n — 1. The image of C under this mapping is denoted by S = 4>{C). 
Hereafter, we may not distinguish cgC from its image s<eS when representing a codeword. Let 
dn(v^ ,y^) = Wh(v^ — y^>) be the Hamming distance between two binary vectors and 
Then their Euclidean distance ||0(^^) — 0(^ ( - 2 - ) )|| is equal to 2a/ d H {v^ ,v^). Obviously, 
the vectors in A% (hence the bipolar codewords) are distributed on an n-dimensional sphere of 
radius y/n centered at the origin O of R n . We have the following lemma. 

Lemma 1: Let u, v and w be three bipolar vectors of length n. Let 9 be the angle formed by 
the two vectors ui = v — u and mb. Then we have 




(4) 



where di = dniu^v) and d 2 = d H (u,w). 
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Proof: To make the proof more readable, we have drawn the three bipolar vectors in a 
three-dimensional space, as shown in Fig. ED (a). In essence, with a properly chosen orthogonal 
transformation, the three vectors can be viewed as three points in M 3 (a three-dimensional 
subspace of IR n ). It should be noted that orthogonal transformations preserve inner products 
and (hence) lengths as well as angles. 



It has been pointed out in 112011 (without proof) that any three bipolar vectors form a non-obtuse 
triangle, which means 9 < n/2. For completeness, we re-derive this bound in a detailed way. 
Let 9 be the angle formed by ui and wJo. It suffices to prove that the inner product ui ■ mb is 
non-negative. Actually, if v t ^ w t , (v t — u t )(w t — u t ) = since either v t = u t or w t = u t must 
hold; if v t = w t , (v t — u t )(w t — u t ) > 0. Therefore 

ut) ■ mh = jXvt - u t ){w t - ih) > 0. (5) 
t 

To complete the proof of this lemma, consider the circumscribed circle of the triangle formed 
by the three points u, v and w (Fig. \T\ (b)). Let r be its radius. The angle can be written as 
9 = 9i + 9 2 , where cos^ = ||m>||/(2r) and cos# 2 = ||my||/(2r). It is then not difficult to verify 
that 



9 = arccos h arccos . (6) 

Noticing that the right hand side (RHS) of © is increasing with r and that r < y/n, we have 

9 < arccos \ — + arccos \ — . (7) 
V n V n 



B. Union Bounds 

Let c = (c , c 1; • • • , c n _i) G C be a codeword. Suppose that s = 0(c) is transmitted over an 
AWGN channel. Let y = s+z be the received vector, where z is a vector of independent Gaussian 
random variables with zero mean and variance a 2 . For AWGN channels, the ML decoding is 
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equivalent to finding the nearest signal vector s G S to y. A decoding error occurs whenever 
s 7^ s. Let E be the decoding error event (under ML decoding). Generally, it is a difficult 
task to calculate the decoding error probability Pi{E}. Hence one usually turns to bounding 
techniques. Due to the symmetry of the channel and the linearity of the code, the conditional 
error probability does not depend on the transmitted codeword, see, e.g., Q2l|] . Therefore, without 
loss of generality, we assume that the all-zero codeword is transmitted. The simplest upper 
bound is the union bound 



Pr{£} = Prj|j£ d j 
< 5>r{£ d } 



where Ed is the event that there exists at least one codeword of Hamming weight d > 1 that is 
nearer than to y, and Q ( ^ j is the pair- wise error probability with 



r-t-oo i 2 

Q(x) = / —j=^ dz. (9) 

The question is, how many terms do we need to count for the summation in the above bound? 
If too few terms are counted, we will obtain a lower bound of the upper bound, which may be 
neither an upper bound nor a lower bound; if too many are counted, we need pay more efforts 
to compute the distance distribution and only a loose upper bound will be obtained. To get a 
tight upper bound, we may determine the terms by analyzing the facets of the Voronoi region 
of the codeword Il22ll [12011 . which is a difficult task for a general code. 

It is well-known that the conventional union bound is loose and even diverges (> 1) in the 
low-SNR region. One objective of this paper is, without too much complexity increase, to reduce 
the number of involved terms in the conventional union bound. The other objective of this paper 
is to tighten the bound on Pr{i^}, which used to be upper-bounded by the pair- wise error 
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probability, where intersections of half-spaces related to codewords other than the transmitted 
one are counted more than once. For some of well-known existing improved bounds based on 
GFBT, such as the sphere bound (SB), the tangential- sphere bound (TSB) and the Divsalar 
bound, see the monograph [|2| Ch. 3] and the references therein. 

III. Upper Bounds Using Truncated Weight Spectrum 



Recently, Ma et al 111911 proposed a union bound which involves only truncated weight spec- 
trum. In this section, we re-derive this "truncated" union bound within the framework of GFBT, 
where the region 1Z is defined in an unusual way based on the following conceptual suboptimal 
list decoding algorithm. 

Algorithm 1: (A list decoding algorithm for the purpose of performance analysis) 

51. Make hard decisions, i.e., for < t < n — 1, 

I 0, y t > 

Vt=< • (10) 

[ i, yt<o 

Then the channel c t — > y t becomes a memory less binary symmetric channel (BSC) with 
cross probability pi, = Q Q). 

52. List all codewords within the Hamming sphere with center at y of radius d* > 0. The 
resulting list is denoted as C y . 

53. If C y is empty, declare a decoding error; otherwise, find the codeword c* G C y such that 
4>(c*) G S is closest to y. 

□ 

Now we define 

U = {y |c (0) g Cy) . (11) 

In words, the region 1Z consists of all those y having at most d* non-positive components. 
The decoding error occurs in two cases under the assumption that the all-zero codeword is 
transmitted. 
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Fig. 2. Graphical illustrations of the decoding error events. 



Case 1. The all-zero codeword is not in the list C y (see Fig. |2] (a)), that is, y 1Z, which 
means that at least d* + 1 errors occur over the BSC. This probability is 

— L — ' \m J 

m=d*+l x 7 

Case 2. The all-zero codeword is in the list C y , but is not the closest one to y (see Fig. [2](b)), 
which is equivalent to the event {E, y 6 7?.}. This probability is upper-bounded by 

Pr{E,yen} <Pri |J E d , yeizi (13) 

Kd<2d* ) 

since all codewords in the list C y are at most 2d* away from the all-zero codeword and not all 
codewords of a specific weight are in the list. The above upper bound involves only truncated 
weight spectrum. However, the region 1Z is in unknown shape and may not be symmetric, 
which causes difficulties when computing the upper bound. To circumvent this difficulty, we 
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may enlarge 1Z to R n and get 

Pi {E, yell} < Pr j (J £ d , y E K I (14) 

< Pri |J E d , yeR n \ (15) 

ld<2d* J 

= Pri |J E d \ <T u (C 2d *), (16) 

Kd<2d* ) 

where T u {C 2d *) is a computable upper bound on Pr {{J d<2 d* Ed], which depends only on the 
sub-code C 2d * consisting of all codewords with Hamming weight no greater than 2d* . It is worth 
pointing out that, although the sub-code C 2d * may not be linear, most bounding techniques in [|2|] 
can be applied to C 2d * to get such an upper bound under the assumption that the all-zero codeword 
is transmitted. Hereafter, we use the notation C t = {c G C \ Wh(c) < t}. 
For convenience, we define 

m=N t ^ ' 

The function B(p, N t , Ng, N u ), which will be used over and over again in this paper, is just 
the probability that the number of bit-errors occurring in a binary vector of total length N t , 
when passing through a BSC with cross error probability p, ranges from Nt to iV u . Note that 
B(p, N t , Nt, N u ) can be calculated recursively independently of codes. 
Combining (TT2l) . (fT6l) and (fTTT) with ©, we get an upper bound 

Pr{E}<T u (C 2d *) + B(p b ,n,d* + l,n), (18) 

where the second term in the RHS is computable without requiring the code structure and the 
first term depends only on the sub-code C 2d *. 



fl, 



On one hand, similar to the SB fl 1 ON and the TSB [1 1], the proposed upper bound ([TBI involves 
only truncated weight spectrum, which is hence helpful when the whole weight spectrum is not 
computable. On the other hand, if the complete weight spectrum is available, the proposed 
bounding technique can potentially improve any existing upper bounds. 
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Proposition 1: Let T u be an upper-bounding technique. We have 

Pt{E}< min {T u (C 2d *) + B(p b ,n,d* + l,n)}, (19) 

0<d*<n 

which delivers an upper bound strictly less than 1 and not looser than any existing upper bounds 

T U (C). 

Proof: Noting that T U (C ) = and B{p b ,n, l,n) = 1 — (1 — pt) 11 , we have, by setting 

d* = 0, 

Pr{£}<l. (20) 
Similarly, noting that T u (C 2n ) = T U (C) and B(p b , n, n + 1, n) = 0, we have, by setting d* = n, 

Pr{E}<T u (C). (21) 

■ 

Taking the conventional union bound as T u , we have 

Theorem 1: Let <i m i n be the minimum Hamming weight of the code C. We have 

Pr{£}< min J V A d Q f — ] + B{p b , n, d* + 1, n) \ . (22) 

Kd min <d<2d* \ / ) 

Proof: It can be proved by substituting the conventional union bound for T u (C 2 d*) (in the 
same form as shown in ([8])) into (fT9l . ■ 
Remark. The bound (122)) . which is slightly different from that proposed in U3\, requires higher 
computational loads than the conventional union bound. The overhead is caused by recursively 
computing B(p b ,n,d* + l,n) and minimizing over d*. If we do not perform the optimization 
and simply set d* = n, we get the conventional union bound, implying that the technique can 
potentially improve the conventional union bound, as stated in Proposition [Q 

IV. Improved Union Bounds 

We have interpreted the "truncated" union bound as an upper-bounding technique based on 
the GFBT, where the region 1Z is defined by a sub-optimal decoding algorithm. To bound 
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Pt{E, y E 1Z}, we have enlarged 1Z to W 1 , as shown in the derivation from ([141 to (TT3T ). The 
objective of this section is to reduce the effect of such an enlargement. 

Noticing that the event y e 1Z is equivalent to the event Wn(y) < d*, we have 

Proposition 2: 

Pr{E}< min i V Pr {E d , W H (y) < d*} + B(p b , n, d* + l,n)\. (23) 

0<d*<n — 
~ ~ Kd<2d* J 

Proof: For any d* (0 < d* < n), 

Pr{E} < Pi {E,y ell} + Pr{y£"Jl} 

< Prj |J E d ,W H (y)<d* 1+ B(p b ,n,d* + 1, n) 

< J2 Fl { E ^ W H(y)<d*} + B{p b ,n,d* + l,n). (24) 



d<2d* 



In this section, we focus on how to upper-bound Pr {E d , Wn{y) < d*} for any given d and 
d*. Without loss of generality, we assume that A d > 1 and denote all the codewords with weight 
d by c^, 1 < £ < A d . Let E ^ £ be the event that is nearer than to 

A. Union Bounds Using Pair-Wise Error Probability 
Lemma 2: 

Pr {E ^, W H (y) <d*}< Q(Vd/a)B (p b , n - d, 0, d* - 1) . (25) 
Proof: Without loss of generality, let = (1 ■ • • _0). Denote y^ 1 — (yo, - ■ ■ ,y d -i) 

d n—d 

and y^' 1 = (y d , ■ • • , y n -i)- Evidently, only y^~ l can cause the decoding error event that c« is 
nearer than to y. In other words, the event -E^i is independent of y r ^ 1 and Pr-fE^i} = 
Q y/d/a\. Also notice that the received signal vector y which can cause the event E$^i must 
satisfy W H {y*- 1 ) > I- Hence {y\E ^i,W H {y) < d*} C {y|£o-n, W^gp 1 ) < d* - l}. Then 
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we have 

Pr {E ^,W H (y) < d*} < Pi [e^Wh^- 1 ) <d*-l] (26) 

= Pr{^i}Pr{^(^ _1 ) <d*-l} (27) 

= Q(Vd/a)B( Pb ,n-d,0,d* - 1) . (28) 

■ 

Theorem 2: 

Pr {E d , W H (y) <d*}< A d Q(Vd/a)B (p b , n-d,0,d*-l). (29) 

Proof: By union bounds and the symmetries of the error events, 

Pr {E d ,W H (y)<d*} = Pr| |J E ^,W H (y) < d*\ (30) 

[i<e<A d J 

< Pr {Eo^,W H (y) < d*} (31) 

l<i<A d 

= A d Pr{E Q ^W H {y)<d*} (32) 

< A d Q(Vd/a)B(p b ,n-d,0,d* -1). (33) 



B. Union Bounds Using Triplet-Wise Error Probability 

Temporarily, we assume that A d > 2 is even. Then we have 

Pr{E d ,W H (y) <d*} < P*{Eo^2e-i){jEo^2e,W H (y)<d*}. (34) 

i<e<A d /2 

If we can find ways to calculate or upper-bound Pr [E ^ 2 e-i) U Eo^2e, Wh(v) < d*}, we may 
improve the conventional union bound. 

In this paper, we refer to the probability Pr {E ^i \J E ^ 2 } as triplet-wise error probability. 
We have the following lemma. 
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Lemma 3: Let be the all-zero codeword with bipolar image s_(°\ Let and be the 
codewords of Hamming weight d with bipolar images and s^ 2 \ respectively. The triplet- wise 
error probability 

vd— £ i cos 8 

/4-oq __L 
_ y /(&) d£ 2 <1Ci. (35) 

where /(x) = - 7 =-e _a;2 ^ 2<T2 ^ is the probability density function of A/"(0, a 2 ) and 6> is the angle 
formed by the two vectors s^s^ and s^s^. Furthermore, the triplet- wise error probability is 
a non-decreasing function of 0. 

> 

Proof: Similar to the proof of Lemma [H we have sketched the two vectors s^s^ and 
s^s^ in a two-dimensional space, as shown in Fig. [31 where we have chosen as the origin 
O and arranged s^s^ on the abscissa axis 0^\. 

Assume that s} ' is transmitted and y = s(°> +z is received, where z is a sample from a random 
vector Z_ whose components are independent and identically distributed as A/"(0, cr 2 ). Let 
and Z^ 2 be the two independent Gaussian random variables by projecting Z_ onto the abscissa 
axis and ordinate axis, respectively. Specifically, say, is the inner product (Z_, / w ~^ oi ,, ). It 
is well-known that only (Z^, Z^ 2 ) can cause the error event {E ^i |J E _+ 2 }- Actually, as shown 
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in Fig. [31 the error event {-Eo^i U-^0^2} occurs if and only if the vector (Z^, Z^ 2 ) falls into 
the shaded region, which can be partitioned into 

fti = {(6,6)16 > v 7 ^, ^cos9 + 6 sin 9 < v 7 ^}, (36) 
n 2 = {(fi,&)|&cos0 + &siii0> Vd}. (37) 

! yfd— £1 cos 

Since Pr{^!} = /(&) J^^~ /(&) d& d& and Pr{^ 2 } = Q(y/d/a), we have 
Prj^ilJ^} = Pr{^!} + Pr{^ 2 } 

\fd — P 1 cos 
/* + OO /» 

= / /(6) / Sm /(6)d6dei + g(v / rf/a). (38) 

To prove the monotonicity, it suffices to prove that ^~f^g° sd increases with 6 for £1 > \fd. 
This can be verified by noting that its derivative &-^\ c ° s0 > for £1 > \fd. U 

Lemma 4: For any two codewords and of Hamming weight d, the triplet-wise error 
probability^ 

Pr {^(J^o-a} < 2g(v / rf/a) - Q 2 (Vd/a). (39) 
Proof: From Lemmas [T]and|3l we can substitute 9 = n/2 into (1351) to complete the proof. 



Remark. From Lemmas [H and |3] in the case of arccos y ^ < 7r/4, we may substitute = 
2 arccos into (1351) to get a tighter bound, however, which needs higher computational loads. 
Lemma 5: For any two codewords and of Hamming weight d, 

Pr {Eq-i (J VM£) < d* } < (2Q(Vd» - Q 2 (v^/a)) S(p b , n - 2d, 0, d* - 1). (40) 

Proof: Without loss of generality, assume that 

^ = (^■■■^1^) (41) 

n-2d 



l As pointed out by an anonymous reviewer that the RHS of d39t is the same as the symbol error probability of quadrature 
phase shift keying (QPSK) over AWGN channels fl . 
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and 

^"(^■••cSUo^O). (42) 

n-2d 

Then only y 2 ^ 1 can cause the event that or c^ 2 ' are nearer than to y. Also notice that 
the received signal vector y which can cause the event £b->i U ^b->2 must satisfy WhO/ 2 ^ 1 ) > 
1. Hence {y\E ^i \J E ^ 2 , W H {y) < d*} C {y|E _i U #0-2, W^" 1 ) < rf * " l}- Then we 
have 

Pi{E -> 1 \jE -> 2 ,W H (y) < d*} <Pr {Eo^IJEo^Wh^ 1 ) < d* - l} (43) 

= Pr {^iU^} Pr {Wh^; 1 ) < d* - l} (44) 
< (2Q(Vd/a) - Q 2 (Vd/<r)) S(p 6 , n - 2d, 0, d* - 1)(45) 

from Lemma HI ■ 
The main result of this subsection is the following theorem, which shows that the union bound 

based on triplet-wise error probabilities can be tighter than the conventional union bound based 

on pair-wise error probabilities. 
Theorem 3: If A d is even, 

Px{E d , W H {y) <d*}<A d \Q{Vd/a) - ^Q 2 {Vd/a)j B(p b , n - 2d, 0, d* - 1); (46) 

if A d is odd, 

Pv{E d ,W H (y) < d*} < (A d -l)\Q(Vd/a)-^Q 2 (Vd/a)^B(p b ,n-2d,0,d*-l) 

+Q(Vd/a)B(p b ,n-d,0,d* - 1). (47) 
Proof: If A d is even, we have 
Pr{E d} W H (y) < d*} < J2 Pr {Eo^pt-D \J E ^ Wh( & ^ d *} 



< 

~ 2 



i<e<A d /2 
A d 



(2Q(Vd/a) - Q 2 (Vd/a)) B{p b , n - 2d, 0, d* - 1) 
A d (Q(Vd/a) - W(Vd/cj)] B{p b ,n- 2d,0,d* - 1), (48) 
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which follows from the symmetries of the error events and Lemma [5J 
If A d is odd, we have 



Pr{E d ,W H (y) < d*} 

< Pr {^(2^-1) |J Eq^u, W H (y) < <f} + Pr {E ^ Ad , W H (y) < d*} (49) 

i<e<(A d -i)/2 

< (A d - 1) \Q(Vd/a) - ^Q 2 (Vd/a)j B(p b , n - 2d, 0, d* - 1) 
+Q(Vd/a)B(p b ,n-d,0,d* - 1), (50) 

which follows from the symmetries of the error events and Lemmas |2] and \5\ ■ 
Note that the bounds in Theorem |3] will not always improve the bounds in Theorem |2l since 
it may happen that B(p b , n - 2d, 0, d* - 1) > B(p b , n - d, 0, d* - 1). 

V. Adaptations of the Improved Union Bounds 

A. Bounds for An Ensemble of Codes 

As we know, most existing bounds are applied to ensembles of codes as well as specific 
codes. However, the bounds given in Theorem |3] can not be applied directly to ensembles of 
codes because the average weight spectra of a code ensemble are usually not be integer- valued. 

Theorem 4: Consider a code ensemble ^ with probability distribution Pr{C}, C G Let 
{A c d } be the weight spectrum of a specific code C. Then A d = Ylc^i^}^ ^ s referred to as 
the average weight spectra. Define 

A d Q(Vd/a)B(p b ,n-d,0,d* -1), 
h(A d ) = mm { ^ }.(5l) 

(A d - 1) (Q(Vd/a) - \Q 2 {Vd/afj B(p b , n - 2d, 0, d* - 1) + Q(Vd/a) 
Then Pr{E d , W H (y) < d*} < h(A d ). 
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Proof: From Theorem |2] we have 

Pv{E d ,W H (y) < d*} = ^PT{C}PT{E d ,W H ($) < <f\C} 

c 

< ^Px{C}A c d Q{Vd/a)B{p b ,n-d^d* -1) 
c 

= A d Q(Vd/a)B(p b ,n-d,0,d* - 1). (52) 
It can be verified from Theorem [3] that, for any A c d > 0, 

Pr{E d ,W H (y) < d*\C} < (A d - 1) \ Q{Vd/a) - ^Q 2 (Vd/a)j B(p b , n - 2d, 0, d* - 1) 

+Q(v / rf/a). (53) 

Then, we have 

Pr^Wir (£)<<**} 

= Y,Pr{C}Pr{E d ,W H (y)<d*\C} 
c 

< ^Pr{C}|(^ - l)\Q{Vd/a) - ^Q 2 (Vd/a)^B(p b ,n- 2d,0,d* - 1) + Q(Vd/a)^ 

= (A d -l)(^Q(Vd/a)~^Q 2 (Vd/a)^B(p b ,n-2d,0,d*-l) + Q(Vd/a). (54) 
Combining (l52l) and (l54l) . and taking into account the definition of h(A d ), we have 

Pv{E d ,W H (y) <d*}<h(A d ). (55) 



We now summarize the main result in the following theorem, which can be applied to both 
specific codes and ensembles of codes. 

Theorem 5: Let {A d } be the (average) weight spectrum of a specific code or a code ensemble. 
The word-error probability can be upper-bounded by 

Pr{E} < min { V h(A d ) + B(p b} n, d* + 1, n) \ . (56) 

Kd<2d* ) 
January 19, 2013 DRAFT 
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Proof: Since a specific code is a special case of a code ensemble with a degraded probability 
distribution, we consider only a code ensemble. 

Combining Theorem |4] with Proposition |2] or equivalently, substituting (1551) into (|23]) . we then 
have (l56l) . completing the proof. ■ 

5. Bounds for Bit-Error Probabilities 

In order to adapt the upper bound (|56l ) to the bit-error probability, we define 

i d = max{i | A iA > 0} , (57) 

4 = Ej^M (58) 

i 

and 



AiQ(Vd/tT)S(p 6 ,n-d,0,tf-l), 
= min < ^ _ ^.(59) 

* ((Xd-1) (Q(v / rf/a)-|g 2 (v / rf/a)) J B(p b ,r2-2d,0,d*-l) + g(v / rf/a) 



We have the following theorem. 

Theorem 6: The bit-error probability can be upper-bounded by 



P b < min \ V + S(p b , n, d* + 1, n) I . (60) 

Proof: Let £/ e F(; be the binary output vector from a decoder when the input to the encoder 
is U_. The bit-error probability associated with the decoder is defined as 11241 p. 9] 



Pb=l J2 Mui^Ui}. (61) 

0<i<k-l 

Given that the all-zero codeword is transmitted, the bit-error probability can be rewritten as 

« = E<*2<&>, (62, 



k 



where E is the mathematical expectation. 
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Now we assume that Algorithm \T\ is implemented as the decoder. Without loss of generality, 
we make an assumption that U_ is uniformly at random chosen from F| whenever Algorithm [T] 
reports a decoding error. Recall that 7Z = ly\c^ G C y ^ as defined in (fTTI) . We assume the 
following partition 71 = {J d 7l d , where y G 7Z d if and only if Algorithm Q] outputs one codeword 
with Hamming weight d. We have 

kP b = Pr{y G K}E{W H (U) \ye7Z} + Pr{y £ K}E{W H (U) \y £ 71} 

< Pi{y G 7Z}E{W H (LL) \ye7Z} + kPr{y £ 71} 

< Fl k G K d }E{W H (U)\y e 7Z d } + kB( Pb , nj d* + l,n), (63) 

d<2d* 

where we have used the fact that E{W H (U)\y <£7l} < k. 

Now we focus on how to upper-bound Pr{y G 7Z d }E{W H{tO\y G 7Z d } for any given d < 2d* . 
On one hand, 

E{W H (U)\ye7Z d }<i d (64) 

by the definition of i d and 

Pr{v e K d } < (A d - 1) \Q(Vd/a) - ^Q 2 (Vd/a)j B(p b , n - 2d, 0, d* - 1) + Q(v / d/a) (65) 



from the unified upper bound (1531 based on triplet-wise error probabilities. 

On the other hand, we assume the following partition 7Z d = [j £ 7Z d \ where y G 7Z d whenever 
Algorithm [H outputs c^, 1 < £ < A d . Denote by the input binary vector to the encoder 
corresponding to the codeword c^. Since Pr{y G 7Z d ^} < Pr{E ^.£,y G 7Z}, we have 

Pr{yeK d }E{W H (U)\yeK d } = £ Pr{y e (66) 



1<£<A) 



< ]T Pr{^,y G^}W ff (««) (67) 



< fcA' d Q I — I B(p 6 , n - d, 0, tf - 1) (68) 



a 



from the definition of A' d and Lemma [21 
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Now we have two upper bounds on Pr{y G 1Z d }^{W H (lP)\y G 1Z d }. One is (1681 ), and the 
other can be obtained by combining (|64l) and (165b . Taking into account the definition of h'(Ad), 
we have 

Pr{y G ^}E{W^(0|2/ G ^} < kh'(A d ). (69) 



Substituting (1691 ) into (1631) and minimizing over d*, we have 

fcP 6 < min \ V fe/i'^) + kB{p b , n, d* + 1, n) I . (70) 

Dividing by A; on the both sides of (1701) , we complete the proof. ■ 
Remark. The bound on the bit-error probability given above is applicable to the optimal 
decoding algorithm that minimizes the bit-error probability, but will not always be applied to 
the ML decoding algorithm. In other words, the ML decoding algorithm, which is not optimal 
for minimizing the bit-error probability, may have a higher bit-error probability. 

VI. Numerical Results 

In this section, by an [n, k] random linear code, we mean a code ensemble in which each code 
is defined by a uniformly at random selected full-rank parity-check matrix of size (n — k) x n. 



As shown in [|25L Appendix D], the average weight spectra of a random linear code [n, k] can 
be found as 

( Offei, 0<d<n 
-1/ < . (71) 

1, d = 

We also need to point out that the weight spectra of the compared BCH codes can be found 



in [12611 . 



A. Comparisons Between the Proposed Bounds and the Existing Bounds 

In this subsection, we present four examples to compare the proposed bounds (1561 ) with the 
existing bounds on word-error probability. 
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E b /N Q [dB] 



Fig. 4. Comparison between the upper bounds on the word-error probability under ML decoding of random binary linear block 
codes [100, 95]. The compared bounds are the original union bound, the TSB and the proposed bound. 




E b /N [dB] 



Fig. 5. Comparison between the upper bounds on the word-error probability under ML decoding of random binary linear block 
codes [100, 50]. The compared bounds are the original union bound, the TSB and the proposed bound. 



n 

Fig. |H and Fig. \5\ show the comparisons between the original union bound ®, the TSB ft 1 lL 
(22)] and the proposed bound (l56l) on word-error probability of [100, 95] and [100, 50] random 
linear codes, respectively, where the former has been used as an example in |2j]. The proposed 
bounds are obtained by optimizing the parameter d*, which may be varied with SNRs. We can 
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Fig. 6. Comparison between the upper bounds on the word-error probability under ML decoding of BCH code [31,26]. 
The compared bounds are the original union bound, the TSB and the proposed bound, which are also compared with the ML 
simulation results. 
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Fig. 7. Comparison between the upper bounds on the word-error probability under ML decoding of BCH code [31,21]. 
The compared bounds are the original union bound, the TSB and the proposed bound, which are also compared with the ML 
simulation results. 
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Fig. 8. Comparison between the upper bounds on the word-error probability under ML decoding of BCH code [63, 39]. The 
compared bounds are the original Divsalar bound, the refined Divsalar bound and the proposed bound. 




Fig. 9. Comparison between the upper bounds on the word-error probability under ML decoding of BCH code [63, 39]. The 
compared bounds are the truncated TSB, the truncated proposed bound and the TSB. These truncated bounds depend only on 
the sub-code C20 consisting of all codewords with Hamming weight no greater than 20. 
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see that the proposed bound improves the original union bound. We can also see that, for the 
random code [100, 95], the proposed bound is tighter than the TSB in the low-SNR region; while 
for the random code [100, 50], the proposed bound is looser than the TSB. This coincides with 
the computational results in ul'A Fig. 3], which tells us that the TSB becomes looser in terms 
of the error exponent with increasing code rates. Note that the solid curve in Fig. 0] is better 
than that in [28, Fig. 3], since Theorem |4] here improves [28, Theorem 2] by employing the 
independence between the error events and certain components of the received random vectors. 



Fig. [6] and Fig. [7J show the comparisons between the original union bound ([8]), the TSB ft 1 lL 
(22)] and the proposed bound (1561 ) on word-error probability of [31, 26] and [31, 21] BCH codes, 
respectively. Also shown are the simulation results. We can see that the proposed bound improves 
the original union bound especially in the low-SNR region. We can also see that the proposed 
bound is almost as tight as the TSB for the [31, 26] BCH code but looser than the TSB for the 
[31, 21] BCH code, which again coincides with the conclusions in 112711 . 

B. Combination of the Proposed Technique with the Existing Bounds 

By Proposition [Q we know that the proposed bounding technique can potentially improve 
any existing upper bounds. To illustrate this, we give an example. Fig. [8] shows the comparisons 
between the original Divsalar bound [12, (55)], the refined Divsalar bound (|T9b by taking Divsalar 
bound as T u and the proposed bound (l56l on word-error probability of [63, 39] BCH code, which 
has been used as an example in 111 1M . We can see that the refined Divsalar bound improves the 
original Divsalar bound especially in the low-SNR region. We can also see that the proposed 
bound (l56l) is slightly tighter than the refined Divsalar bound. For this [63, 39] BCH code, we 
have also combined the proposed bounding technique with the SB and the TSB. However, we 
found that the optimal parameter d* is n and hence no improvement is achieved for the SB and 




the TSB. 
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C. Comparisons Between the Truncated Proposed Bound and the Truncated Existing Bounds 

As we have mentioned above Proposition [Q the proposed bounding technique is helpful when 
the whole weight spectrum is unknown or not computable, as is similar to the SB and the TSB. 
Hence, it makes sense to compare these truncated bounds. To illustrate this, we take the [63, 39] 
BCH code as an example. To get the weight spectra, one may need to perform the algorithms 



in Ii29ll . Given d, the upper bounds of the computational complexity for computing Ad can be 
found in II291 Lemmas 5 & 7]. For example, one needs about 10 5 and 10 8 attempts of Algorithm 1 



in Il29ll for d = 9 and d — 13, respectively, as given in [I29L Section VI]. Evidently, the fewer 



Ad (0 < d < n) we use, the lower computational complexity the algorithm has. Assume that 
we know only the truncated weight spectrum {A d , d < 20}. Then we can obtain the truncated 
proposed bound based on (|56l ) and the truncated TSB based on Jill (22)], as shown in Fig. [9] 
Also shown in Fig. [9] is the TSB ft 1 lL (22)] with the whole weight spectrum. We can see that the 
truncated proposed bound is looser than the TSB, but tighter than the truncated TSB especially in 
the high-SNR region. Note that both two truncated bounds are optimized based on the truncated 
spectrum. For example, the truncated proposed bound is obtained by optimizing the parameter 
d* (0 < d* < 10) in ([56]). 



VII. Conclusions 

In this paper, we have presented new techniques to improve the conventional union bounds 
within the framework of GFBT Compared with the conventional union bound, the proposed 
bounds are tighter but have a similar complexity because they involve only the weight spectra 
and the Q-function. The proposed bounds are also helpful when the whole weight spectrum is 
unknown or not computable. Numerical results show that the proposed bounds can even improve 
the TSB in the high-rate region. 
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